Hill-climbing Nds Random Planted Bisections

نویسندگان

  • Ted Carson
  • Russell Impagliazzo
چکیده

We analyze the behavior of hill-climbing algorithms for the minimum bisection problem on instances drawn from the \planted bisection" ran-is one of the few problem distributions for which various popular heuris-tic methods, such as simulated annealing, have been proven to succeed. However, it has been open whether these sophisticated methods were necessary , or whether simpler heuristics would also work. Juels 15] made the rst progress towards an answer by showing that simple hill-climbing does suuce for very wide separations between p and q. Here we give a more complete answer. A simple, polynomial-time, hill-climbing algorithm for this problem is given and shown to succeed in nd-ing the planted bisection with high probability if p ? q = ? n ?1=2 ln 4 n. For dense graphs, this matches the condition for optimality of the planted bisection to within a poly-logarithmic factor. Furthermore, we show that a generic randomized hill-climbing algorithm succeeds in nding the planted bisection in polynomial time if p ? q = ? n ?1=4 ln 4 n. This algorithm is a degenerate case of both Metropolis and go-with-the-winners. The range analyzed here properly includes those in 12, 9, 15], extending and unifying those results. Thus, to get a provable distinction between simulated annealing and hill-climbing for natural problems will require considerable progress both on new positive results for SA and new negative results for hill-climbing methods.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Why GAs are Hard to Use

Genetic Algorithms (GAs) are increasingly used for such purposes as deriving programs 1] and producing designs for robots 2]. According to the building-block hypothesis and schema analysis of Holland 3] the GA is an eecient search method. However, empirical work has shown that in some cases the method is outperformed by simpler processes such as random-permutation hill climbing 4] and 5]. The p...

متن کامل

The Building Block Fallacy

Genetic Algorithms (GAs) are increasingly used for such purposes as deriving programs 1] and producing designs for robots 2]. According to the building-block hypothesis and schema analysis of Holland 3] the GA is an eecient search method. However, empirical work has shown that in some cases the method is outperformed by simpler processes such as random-permutation hill climbing 4] and 5]. The p...

متن کامل

A Study On Hill Climbing Algorithms For Neural Network Training

This study empirically investigates variations of hill climbing algorithms for training artiicial neural networks on the 5-bit parity classiication task. The experiments compare the algorithms when they use diierent combinations of random number distributions, variations in the step size and changes of the neural net-works' initial weight distribution. A hill climbing algorithm which uses inlin...

متن کامل

Genetic Algorithms: Combining Evolutionary and `Non'-Evolutionary Methods in Tracking Dynamic Global Optima

The ability to track dynamic functional optima is important in many practical tasks. Recent research in this area has concentrated on modifying evolutionary algorithms (EAs) by triggering changes in control parameters, ensuring population diversity, or remembering past solutions. A set of results are presented that favourably compare hill climbing with a genetic algorithm, and reasons for the r...

متن کامل

The Enigma of SAT Hill-climbing Procedures

In this paper, we investigate a family of hill-climbing procedures related to GSAT, a greedy random hill-climbing procedure for satissability. These procedures are able to solve large and diicult satissability problems beyond the range of conventional procedures like Davis-Putnam. We explore the r^ ole of greediness, randomness and hill-climbing in the eeectiveness of these procedures. We show ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2001